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ABSTRACT 


An  algorithm  for  the  Satisfiability  problem  is  presented  and  its  probabilistic  behav¬ 
ior  is  analysed  when  combined  with  two  other  algorithms  studied  earlier.  The  analysis  is 
based  on  an  instance  distribution  which  is  parameterized  to  simulate  a  variety  of  sample 
characteristics.  The  algorithm  dynamically  assigns  values  to  literals  appearing  in  a  given 
instance  until  a  satisfying  assignment  is  found  or  the  algorithm  “gives  up”  without  de¬ 
termining  whether  or  not  a  solution  exists.  It  is  shown  that  if  n  clauses  are  constructed 
independently  from  r  boolean  variables  where  the  probability  that  a  variable  appears  in 
a  clause  as  a  positive  literal  is  p  and  as  a  negative  literal  is  p  then  almost  all  randomly 
generated  instances  of  Satisfiability  are  solved  in  polynomial  time  if  p  <  .4ln(n)/r  or 
p  >  ln(n)/r  or  p  =  cln(n)/r,  .4  <  c  <  1  and  lim„,r_*oc  n1-c/r1-*  <  oo  for  any  e  >  0.  It 
is  also  shown  that  if  p  =  cln(n)/r,  .4  <  c  <  1  and  limniP_*<»n*r c /r .==  oo  then  almost  all 
randomly  generated  instances  of  SAT  have  no  solution.  Thus  the  combined  algorithm  is 
very  effective  in  the  probabilistic  sense  on  instances  of  SAT  that  have  solutions. 


1.  Introduction 

The  Satisfiability  problem  (SAT)  is  the  problem  of  determining  whether  a  given  collection 
I  of  disjunctions  (clauses)  of  boolean  literals  can  all  be  satisfied  (have  value  true )  by 
some  consistent  assignment  of  truth  values  to  the  literals  of  I  (truth  assignment).  SAT  is 
NP-complete  so  there  is  no  known  worst  case  efficient  algorithm  for  solving  this  problem. 

However,  numerous  algorithms  for  SAT  have  been  shown  to  solve  random  instances 
of  SAT  efficiently  with  high  probability  under  certain  conditions.  Some  of  these  results 
are  based  on  a  parameterized  input  distribution  which  we  denote  by  J(n,r,p).  According 
to  this  distribution  a  random  instance  I  of  SAT  consists  of  n  clauses  constructed  indepen¬ 
dently  from  a  set  V"  of  r  variables  as  follows:  for  each  v  £  V  and  for  all  1  <  t  <  n  place 
v  into  the  ith  clause  of  I  as  a  positive  literal  (that  is,  v)  with  probability  p,  as  a  negative 
literal  (that  is,  v)  with  probability  p  and  leave  v  and  v  out  of  the  ith  clause  with  probability 
1  —  2 p.  In  this  paper,  both  p  and  n  are  functions  of  r  but,  for  the  sake  of  simplicity,  we 
write  p  and  n  instead  of  p(r)  and  n(r).  In  [10],  [12]  and  [13]  the  average  running  time 
of  several  algorithms  for  SAT  is  obtained  under  J[n,r}p).  The  conditions  under  which  at 
least  one  of  those  algorithms  runs  in  polynomial  average  time  are  as  follows: 

1)  limr_oo  rp  =  0,  n  >  r  ln(2)/  —  ln((r  +  l)p). 

2)  limr— oo  rp  =  oo,  lim,—,,*,  p  =  0,  n  >  ln(2 )e2rp/ep. 

3)  limr—oo p  —  0,  np  <  c  constant. 

4)  limr_oo  1/p  =  polynomial(r),  np  <  rcp,  c  constant. 

5)  n  <  cln(r),  c  constant. 

In  [6]  it  was  shown  that  two  trivial,  polynomial  time  algorithms  nearly  always  solve 
random  instances  of  SAT  generated  according  to  J(n,r,p)  under  conditions  which  subsume 
1),  2)  and  4)  above.  Specifically,  consider  the  following  two  algorithms: 

MV  : 

Construct  a  random  truth  assignment  t  to  the  variables  of  I 
Check  whether  t  satisfies  I 
If  t  satisfies  I  then  return(<) 

Else  return(“give  up”) 


MI)  : 

For  all  clauses  c  6  / 

If  c  contains  no  literals  then  return(‘no  solution  possible’) 
Return(“give  up”) 


2 


In  Ai  a  random  truth  assignment  is  found  by  choosing  the  value  true  for  each  variable 
with  probability  1/2  (consequently  the  value  false  with  probability  1/2)  independently 
of  the  assignment  of  values  to  other  variables.  Clearly,  generating  and  checking  a  truth 
assignment  cam  be  accomplished  in  polynomial  time  and  if  a  truth  assignment  t  is  returned 
by  Ai{I)  then  t  satsifies  I.  Clearly,  Ai  runs  in  polynomial  time.  Since  no  truth  assignment 
can  satisfy  a  null  clause,  if  Ai{I)  returns  the  expression  “no  solution  possible”  then  I  is 
not  satisfiable.  Thus  the  collection  Ai  and  A 2  solves  instance  I  of  SAT  in  polynomial 
time  if  and  only  if  both  do  not  “give  up”.  In  [6]  it  vas  shown  that  A\  gives  up  with 
probability  tending  to  0  under  *7(n,r,p)  if  p  >  ln(n)/r.  It  was  also  shown  in  [6]  that  A2 
gives  up  with  probability  tending  to  0  under  J(n,r,p)  if  1)  p  <  ,4ln(n)/r  and  n  <  2r  or  2) 
p  <  ln(n)/(2r)  and  n  and  r  are  polynomially  related.  If  n  >  2r  then  exhaustive  search  will 
solve  instances  of  SAT  in  polynomial  time  so  we  won’t  consider  this  case  here.  Thus  A\ 
and  A2  collectively  are  a  probabilistically  effective  method  for  solving  SAT  under  J(n,r,p ) 
when  p  >  In (n)/r  or  p  <  ln(n)/(2r)  and  n  and  r  are  polynomially  related  or  p  <  .4ln(n)/r. 
One  interpretation  of  this  result  is  that  random  instances  of  SAT  generated  according  to 
J(ra,r,p)  are  trivial  over  the  range  of  p  indicated  in  the  previous  sentence.  Note  that 
condition  3)  above  becomes 

3a)  limr_00p  =  0,  nln(n)  <  cy/r  ln(r),  c  constant 


in  the  range  .4ln(n)/r  <  p  <  In (n)/r  and  3a)  subsumes  5)  over  that  range  of  p. 


Figure  1  shows  the  relationships  between  p,  r  and  n  for  which  random  instances  of 
SAT  generated  according  to  J(n,r,p)  are  known  to  be  solved  in  polynomial  time  with 
probability  tending  to  1  by  some  previously  analyzed  algorithm.  Also  shown  in  this  figure 
is  a  line  marked  “SAT  BOUNDARY”  which  divides  the  parameter  space  into  two  regions 
such  that  if  the  parameters  are  set  to  values  that  correspond  to  a  point  to  the  left  of 
the  line  then  almost  all  instances  generated  are  unsatisfiable  (more  explanation  will  be 
given  at  the  end  of  section  4).  The  unbounded  region  bordered  by  lines  I  on  the  left 
and  II  on  the  right  corresponds  to  parameter  settings  that  generate  instances  which  are 
not  solved  in  polynomial  time,  almost  always,  by  any  previously  considered  algorithm  if 
nln(n)  >  cy/r ln(r),  c  constant.  In  this  paper  we  investigate  the  question:  how  hard 
are  the  instances  in  this  region?  That  is,  how  hard  are  the  instances  generated  when 
.4ln(n)/r  <  p  <  ln(n)/r  and  nln(n)  >  cy/r  ln(r)?  Are  the  instances  in  this  range  of  p  and 
n  solved  trivially  in  some  other  sense?  Or,  are  these  instances  so  hard  that  no  alogrithm 
which  performs  well  in  some  probabilistic  sense  on  these  instances  exists?  Or,  are  there 
three  regions  of  values  for  p  such  that  in  one  region  trivial  instances  are  predominantly 
generated,  in  the  second  region  non-trivia!  instances  are  generated  but  these  can  be  solved 
in  probabilistic  polynomial  time  by  non-trivial  algorithms,  and  in  the  third  region  hard 
instances  are  predominantly  generated?  These  questions  are  answered,  in  part,  by  the 
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results  presented  in  this  paper.  We  consider  the  probabilistic  performance,  under  J(n,r,p ) 
and  in  the  range  .4ln(n)/r  <  p  <  ln(n)/r,  of  an  algorithm  based  on  the  Davis- Putnam 
Procedure. 


The  Davis-Putnam  Procedure  (DPP)  [5]  is  a  well  known,  much  studied  method  for 
solving  instances  of  SAT  and  is  the  basis  of  most  algorithms  for  SAT.  During  execution 
of  DPP  truth  values  are  assigned  to  variables  sequentially.  Each  assignment  results  in 
some  satisfied  clauses  and  some  falsified  literals  within  clauses  that  are  not  satisfied.  A 
clause  which  is  not  satisfied  by  the  current  partial  assignment  and  contains  exactly  one 
literal  that  has  not  been  falsified  is  called  a  unit  clause.  An  unassigned  literal  whose 
complement  does  not  appear  in  any  unsatisfied  clause  is  called  a  pure  literal.  In  expressing 
DPP  it  is  convenient  to  regard  clauses  to  be  sets  of  non-falsified  literals  and  instances 
to  be  multisets  of  clauses.  Also,  if  v  is  a  literal  (positive  or  negative)  it  is  convenient 
to  use  the  notation  comp{y )  to  mean  the  literal  which  is  complementary  to  v.  Let  L  = 
{t>i ,  vj , . . . ,  vr ,  vi ,  t>2 , . . . ,  vr}  be  a  set  of  2 r  literals  from  which  clauses  are  composed  initially 
and  let  I  be  a  collection  of  clauses.  The  Davis-Putnam  procedure  is  stated  as  follows: 

DPP(I,  L): 

If  I  =  <f>  then  return(“satisfiable”) 

If  3c  G  I  such  that  c  =  <f>  then  return(“unsatisfiable”) 

While  there  is  a  unit  clause  (u)  in  I 

I  <—  (c  -  (comp(v)}  :  c  €  I  and  v  g  c} 

L  <—  L  —  {v,comp(v)} 

While  there  is  a  pure  literal  v  in  I 
I  <—  (c  :  c  6  /  and  v  ^  c} 

L  *—  L  —  {v,comp(v)} 

Choose  a  literal  v  from  L 

I\  <—  {c  —  {comp(v)}  :  c  G  I  and  v  £  c} 

I 2  * —  {c  —  {v}  :  c  €  /  and  comp(v)  £  c } 

L  <—  L  —  {v,comp(v)} 

If  DPP(/1,L)=“satisfiable’1  or  DPP(I2,  L)=“satisfiable” 

Then  return(“satisfiable”)  else  return(“unsatisfiable”) 


The  algorithm  we  analyze  in  this  paper  is  the  following 


A»(I) * 

While  I  ±  <f>  and  Vc  G  J,  c  ^  <j> 

If  there  is  a  unit  clause  {«}  £  I  then  v  *—  u 
Else  choose  a  literal  v  randomly  from  L 
I  <—  {c  —  (comp(v)}  :  c  €  /  and  v  ^  c} 

L  *—  L  —  {v,comp(v)} 

If  /  =  4>  then  return(“satisfiable”) 

Else  return(“give  up”) 

Implicit  in  both  DPP  and  A3  is  the  assignment  of  value  true  to  literal  t;  and,  therefore, 
the  assignment  of  false  to  comp{y).  DPP  and  A3  differ  in  that  literals  are  never  given 
more  than  one  value  during  execution  of  A3  but  literals  may  be  assigned  the  values  true  and 
false  at  different  points  during  execution  of  DPP ;  that  is,  DPP  contains  a  backtracking 
component  whereas  A3  does  not.  Thus,  A3  is  a  polynomial  time  algorithm  whereas  DPP 
requires  exponential  time  on  some  inputs  [9].  However,  A3  is  not  guaranteed  to  find  a 
truth  assignment  (implicitly)  which  satisfies  a  given  instance  of  SAT  if  one  exists.  But, 
if  A3  does  not  “give  up”  then  the  truth  assignment  found  implicitly  by  A3  satisfies  the 
instance  input  to  A3 .  Another  difference  between  A3  and  DPP  is  that  A3  does  not  regard 
pure  literals  as  special. 

In  this  paper  we  show  that  Ai(I),  A-i(I)  and  A3(J)  run  concurrently  on  a  random 
instance  I  of  SAT  generated  according  to  J(n,r,p)  “give  up”  with  probability  tending  to 
0  if  n  <  2r  and  either 

1)  p  <  .4ln(n)/r  or 

2)  p  >  ln(n)/r  or 

3)  p  =  cln(ra)/r,  .4  <  c  <  1  and  lim„iP_oo ln(r)ln2(n)n1_c/r  =  0. 


2.  Other  Probabilistic  Results  for  SAT 

In  addition  to  the  results  stated  in  the  introduction,  a  number  of  probabilistic  results  on 
algorithms  for  SAT  have  been  obtained  under  a  constant-clause-size  model  which  we  refer 
to  as  M(n,r,k).  Under  M(n,r,  ib)  a  random  instance  of  SAT  contains  n  clauses  selected 
uniformly,  independently  and  with  replacement  from  Q*(r)  where  Q*(r)  is  the  set  of  all 
possible  clauses  containing  exactly  k  literals  taken  from  r  variables  and  their  complements 
such  that  no  pair  of  literals  in  the  same  clause  is  complementary.  It  can  easily  be  shown 
that  if  lim„,r_oo  n/r  <  -ln(2)/ln(l  -  2~k)  then  the  expected  number  of  satisfying  truth 
assignments  is  greater  than  Bn  where  B  >  1  and  if  limn,r— oo  n/r  >  — ln(2)/ln(l  —  2  k) 
then  the  expected  number  of  satisfying  truth  assignments  is  less  than  Bn  where  B  <  1. 
Therefore,  since  k  is  independent  of  n  and  r,  the  case  limnir— oon/r  —  ai  where  a  is  a 
constant,  is  important  in  M.  Note  that  lim„)r_oo  n/r  =  — ln(2)/ln(l  —  2  k)  «  2fcln(2) 
represents  a  “flip  point”  in  that  if  the  ratio  of  n  to  r  is  greater  than  the  flip  point  then 
instances  are  nearly  always  unsatisfiable  and  if  the  ratio  of  n  to  r  is  less  than  the  flip  point 
then  the  average  number  of  satisfying  truth  assignments  per  instance  is  exponential  in  r.  If 
Jfe  =  3  (then  the  problem  becomes  the  3-Satisfiability  problem  which  is  still  NP-complete) 
the  flip  point  is  at  n/r  =  5.19. 

In  [3]  it  is  shown  that  A3  finds  solutions  to  random  instances  of  SAT  under  M(n,r,k) 
with  probability  bounded  from  below  by  a  constant  if  limn,r— 00  n/r  <  2fc-1((fc  —  l)/(fc  — 
2))fc~2 /k.  A3  may  be  improved  (and  generalized)  if  the  chosen  literal  is  taken  from  a  clause 
in  I  containing  the  smallest  number  of  literals  of  all  clauses  in  I  instead  of  randomly  if 
there  are  no  unit  clauses  in  I.  The  resulting  generalization  is  shown  in  [3]  to  find  solutions 
to  random  instances  of  SAT  under  M(n,r,fc)  with  probability  bounded  from  below  by  a 
constant  if  lim,,^—,*,  n/r  <  3.08  *  2k~2((k  —  \)/(k  —  2))k~2 /{k  + 1)  —  .75  for  4  <  k  <  40  and 
with  probability  tending  to  1  if  iim*,,.-.,*,  n/r  <  1.845*2fc_2((fc  —  \)/{k  —  2))*~2/(fc  +  l)  —  .75 
for  4  <  k  <  40.  Algorithm  A3  may  also  be  improved  by  choosing  a  variable  randomly 
(when  there  is  no  unit  clause  in  /)  instead  of  a  literal  and  “assigning”  to  it  the  value 
which  satisfies  most  clauses.  In  [2]  it  was  shown  that  this  improvement  allowed  A3  to 
find  solutions  to  random  instances  of  SAT  under  M(n,r,3)  with  probability  bounded  from 
below  by  a  constant  if  limniP_oo  n/r  <  2.9.  Without  the  improvement  A3  has  the  same 
kind  of  performance  if  lim„,r-.oo  n/r  <  2.66  (also  in  [2]). 

Finally,  in  [11]  it  is  shown  that  the  expected  number  of  branches  in  analytic  tableaux 
analysis  in  propositional  calculus  is  exponential  in  the  number  of  occurrences  of  the  con¬ 
nectives  and  and  or  when  instances  are  generated  equally  likely  and  are  such  that  and ,  or 
and  not  are  the  only  connectives  and  negation  is  applied  only  to  atomic  formulas. 


3.  Analysis  of  A3  under  7(n,r,p) 

In  this  section  it  is  shown  that  if  instances  of  SAT  are  generated  according  to  J(n,r,p) 
and  n  <  2r  then  the  probability  that  A3,  A2  and  A3  “give  up”  tends  to  0  as  n,r  — ►  00  if 

1)  p  >  ln(n)/r  or 

2)  p  <  .4ln(n)/r  or 

3)  p  =  cln(n)/r,  .4  <  c  <  1,  and  limn)r—ooln(»*)ln2(n)n1-c/r  =  0. 

We  already  know  that  A  2  “gives  up”  with  probability  tending  to  0  if  p  <  .4ln(n)/r 
and  n  <  2r.  We  also  know  that  A\  “gives  up”  with  probability  tending  to  0  if  p  >  ln(n)/r. 
Therefore,  we  need  only  find  a  similar  result  for  A3  in  the  range  p  =  cln(n)/r,  .4  <  c  <  1, 
and  and  limnir_00ln(r)ln2(n)n1-c/r  =  0.  The  following  two  paragraphs  give  a  rough  idea 
of  how  the  analysis  proceeds. 

At  the  start  of  each  iteration  of  A3  there  is  a  collection  I  of  clauses  to  be  processed. 
During  each  iteration  of  algorithm  A3  a  literal  is  chosen,  clauses  in  I  containing  that  literal 
are  removed  from  I  and  occurrences  of  the  literal  which  is  complementary  to  the  chosen 
literal  are  removed  from  clauses  in  I.  Let  Ci(j)  be  the  collection  of  clauses  in  I  containing 
exactly  i  literals  at  the  start  of  the  j  +  1*‘  iteration.  After  the  j  +  1'*  literal  is  chosen 
there  is  a  flow  of  clauses  into  Ci(j  + 1)  and  out  of  C'j(j).  The  outward  flow  is  the  collection 
of  clauses  that  had  contained  i  literals  prior  to  the  j  +  l4t  iteration  but  either  the  chosen 
literal  or  its  complement  was  one  of  them.  The  inward  flow  is  the  collection  of  clauses  that 
had  contained  i  + 1  literals  prior  to  the  j  +  l*4  iteration  but  a  literal  complementary  to  the 
chosen  literal  was  one  of  them.  Clauses  in  Ci(j)  that  are  also  in  Ci(j  +  1)  are  not  included 
in  the  flow  to  Ci(j  4-1).  Since  each  clause  cm  have  a  maximum  of  r  literals,  there  is  no 
inward  flow  of  clauses  to  Cr(j )  for  any  j.  Algorithm  A3  “gives  up”  only  if  some  clause 
in  I  becomes  null  at  some  iteration  of  A3  or  the  given  instance  contains  a  null  clause.  A 
clause  c  will  become  null  only  if  c  is  a  unit  clause,  there  is  another  unit  clause  in  I  which 
contains  the  literal  that  is  complementary  to  c  and  that  literal  is  chosen  on  some  iteration. 
Thus,  if  A3  is  to  “give  up”  with  low  probability,  the  probability  that  a  pair  of  unit  clauses 
is  complementary  must  be  low  for  any  j  and  the  probability  that  a  null  clause  exists  in 
the  given  instance  must  be  low.  The  latter  probability  can  easily  be  calculated  and  shown 
to  be  low  if  p  >  ln(n)/(2r).  The  former  probability  is  low  if  the  average  flow  of  clauses 
into  C\(j)  is  less  than  1  for  all  0  <  j  <  r.  This  is  because  there  is  a  flow  out  of  Ci(j ) 
of  at  least  1  whenever  there  is  a  clause  in  C\(j)  so  the  average  number  of  unit  clauses 
in  Cj(j)  will  be  bounded  by  a  constant  if  the  average  flow  into  Cj(/),  0  <  l  <  j  —  1,  is 
less  than  one  clause  per  iteration.  If  the  average  number  of  clauses  in  C\(j)  is  bounded 
by  a  constant  then  the  probability  that  a  complementary  pair  of  unit  clauses  appears  in 
Ci(j )  is  bounded  from  above  by  a  constant.  This  constant  can  be  made  arbitrarily  small 
by  appropriately  reducing  the  flow  into  Cj(j)  for  all  j.  Note  that  if  the  average  number 


of  clauses  in  Ci(j)  is  bounded  by  a  constant  then  the  average  flow  of  clauses  out  of  Ci(j) 
will  be  very  close  to  one  clause  per  iteration  when  at  least  one  clause  is  in  C\(j).  Thus,  if 
the  average  flow  into  C\(j)  is  greater  than  one  clause  per  iteration  for  ar  iterations  where 
a  >  0  then  the  average  number  of  clauses  in  Ci(j)  will  increase  and  the  liklihood  that  at 
least  one  complementary  pair  of  unit  clauses  exists  will  become  high. 

We  proceed  with  the  analysis  of  A j  by  developing  a  set  of  flow  equations  for  Ci(j) 
for  all  1  <  i  <  r  and  0  <  j  <  r,  solving  them,  and  finding  the  conditions  which  guarantee 
that  the  average  flow  into  C\(j)  is  small  for  all  j  provided  .4ln(n)/r  <  p  <  In {n)/r.  By 
making  use  of  some  results  from  queueing  theory  these  are  then  shown  to  be  the  conditions 
under  which  Ay  “gives  up”  with  probability  bounded  from  above  by  a  term  tending  to  0 
as  n,r  — ►  oo.  The  flow  equations  are  based  on  the  following  theorem. 

Theorem  1: 

Given  \Ci(j)\  =  rii(j),  for  all  1  <  *  <  r  —  j,  the  clauses  in  C{(j)  are  distributed 
according  to  M(rii(j),r  —  j,i)  independently  of  the  clauses  in  Cj(j),  /  /  i. 

Proofs 

This  is  certainly  true  for  the  case  j  =  0.  Suppose  it  is  true  for  all  0  <  j  <  m.  There  are 
two  ways  the  m  +  l4t  literal  is  chosen  in  A3:  randomly  from  C'i(m)  if  |Ci(m)|  7^  $  or 
randomly  from  the  set  of  unassigned  literals.  Consider  the  second  case.  By  hypothesis, 
if  hi  clauses  of  Ci(m )  contain  the  chosen  literal  or  its  complement,  the  remaining 
rii(m)  —  hi  clauses  of  C<(m)  are  distributed  according  to  —  hj,r  —  m  —  l,i). 

Also,  if  <7,+ 1  clauses  of  Ci+i(m)  contain  the  complement  of  the  chosen  literal,  stripping 
the  complement  of  the  chosen  literal  from  those  clauses  results  in  a  set  of  gi+i  clauses 
distributed  according  to  M(gi+i,r  —  m  —  1 , z).  Combining  the  second  set  of  clauses 
with  the  remainder  of  the  first  set  of  clauses  results  in  a  set  of  n(m)  —  hi  +  gi  clauses 
distributed  according  to  M(ni(m)  —  hi  +  gi,r  —  m  —  l,t)  =  M(ni(m  +  l),r  —  (m  +  l),t)- 
Now  consider  the  case  that  a  literal  appearing  in  a  unit  clause  is  chosen  randomly 
from  the  set  of  all  such  literals.  There  is  one  unit  clause  c  which  contains  this  literal. 
The  remaining  unit  clauses  are  independent  of  c  and  therefore  the  chosen  literal. 
Futhermore,  ail  clauses  in  Cj(m),  m  >  1,  are  independent  of  c.  Hence  the  previous 
argument  applies.  This  establishes  the  result. 

We  can  now  develop  a  set  of  recurrence  relations  for  the  expected  number  of  clauses 
in  C’i(j)  for  all  1  <  i,j  <  r.  From  the  solution  to  these  recurrence  relations  we  will  obtain 
an  expression  for  the  expected  flow  of  clauses  into  Ci(j)  for  all  1  <  j  <  r.  Then  we  will 
find  the  conditions  which  guarantee  that  this  expectation  is  small  enough  in  the  limit.  Let 


-E{ni(j)}  be  the  average  number  of  clauses  in  C{(j)  at  the  start  of  the  j  +  l*1  iteration  of 
A3.  Let  E{zi(j)}  be  the  average  number  of  clauses  that  flow  out  from  C{(j )  as  a  result  of 
choosing  the  j  +  1**  literal.  Let  E{wi(j)}  be  the  average  flow  of  clauses  into  Ci(j  +  1)  as 
a  result  of  choosing  the  j  +  1**  literal.  Then 

+  1)}  =  £{»(«)}  +  -  £{*«)}•  (1) 


Let 

OO 

£{£{^(j)l»i(j)}>  =  E  £{*(i)Mi)  =  W"4))  =  0- 

1=0 


Then,  for  all  2  <  i  <  r 


E{Zi(j)}  =  E{E{*iU)\niU)}} 


i  *  l 


=  51 : — 7Pr(n*(i)  =  0  = 

1=0  j 


i  *  E{ni{j)} 


r  -  3 


because  of  theorem  1.  Also,  for  all  1  <  t  <  r 


=  E 


E{w<(j)}  =  B{£{u»i(j)|ni+1(j)}} 

(i  +  =  0  =  *>  *  £{n<+l0» 


1=0 


2(r  -  j) 


2(r-j) 


and 


%( j)}  =  0. 

Therefore  (1),  for  2  <  i  <  r,  can  be  written 

(*  +  1)  *  ^{ni+i(j)}  i  *  E{ni(j)} 


E{rn(j  +  1)}  =  E{m{j)}  + 


and 


E{nr(j  +  1)}  =  £{nr(j)}  - 


2(r  —  j)  r-j 

r  *  E{nr(j)} 


r  -j 


(2) 


(3) 


In  order  to  solve  equations  (2)  and  (3)  we  need  the  boundary  conditions  jE{nj(0)}  for 
2  <  i  <  r. 


Lemma  1: 


Proof: 


Since  Ip  is  the  probability  that  a  literal  associated  with  a  particular  variable  is  con¬ 
tained  in  a  particular  clause  of  a  given  instance  I  and  since  literals  are  placed  in 
clauses  independently,  the  probability  that  a  clause  of  I  has  exactly  i  literals  is 
(i)(2p)‘(l  —  2 p)r~t.  The  desired  expectation  is  the  product  of  the  number  of  clauses 
in  an  instance,  n,  and  that  probability. 

The  required  bounds  on  solutions  to  (2)  and  (3)  with  the  boundary  conditions  given 
in  lemma  1  are  given  in  theorem  2.  In  theorem  2  we  use  the  convention  that  =  0  if 
w  >  x. 

Theorem  2: 


For  all  .41n(n)/r  <  p  <  ln(n)/r,  0  <  j  <  r,  2  <  i  <  r 


£{»<«)}  =  ("  ;  ',)(2P)i(l  -  ?)>(!  -  2p)r-'~’n. 


Proof: 


The  proof  is  by  induction.  The  hypothesis  is  true  for  j  —  0  since  -E{rij(0)}  = 
(i)(2p)'(l  ~  2 p)r~'n  and  for  i  =  r  since  £{nr(j')}  =  0  for  all  1  <  j.  The  hypothesis  is 
also  true  for  i  >  r  —  j  since  E{nt(j)}  =  0  in  that  range.  Now  suppose  the  hypothesis 
is  true  for  all  a  <  i  <  r,  0  <  j  <  b  and  a  +  l<i<r,  b  <  j  <  r  —  a  where  a  is 
any  integer  greater  than  or  equal  to  2  and  less  than  or  equal  to  r  and  6  is  any  integer 
greater  than  or  equal  to  0  and  less  than  or  equal  to  r  —  a.  We  show  that  this  implies 
it  is  also  true  for  i  =  a  and  j  =  b  1.  By  applying  the  hypothesis  to  equation  (2)  we 
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O’.-'--; 


vVVWOv 


E(n.(h  +  1)}  =  (r  o  ‘)(2p)“(l  -  p)l(l  -  2 p)'— *  (l  -  -O  n 

(2p)“+1(l-p)‘(l-2pr-‘-n 

1)(2p)“(l-p)‘(l-2pr“-‘n 

(r  —  b 

+  K  « 

_ ‘V2p)*(l  -  p)»(l  -  2p)'— 1 *-’n 

II 

-T' 

i 

ft  Cr- 
1 

(2p)“(X  -  p)‘(l  -  2 p)-— ((1  -  2p)  +  p)  n 

■CT 

1)(2p)“(l  -  P)‘+,(1  -  2p)--‘-V 

The  main  result  is  stated  as  follows. 

Theorem  3: 

The  probability  that  A\ ,  A2  and  A3  “give  up”  when  concurrently  applied  to  a  random 
instance  of  SAT  generated  according  to  J(n,r,p)  tends  to  0  as  n,r  ->  00  if  n  <  2r 
and  either  of  the  following  three  conditions  hold: 

1.  p  <  .4ln(n)/r 

2.  p  >  In (n)/r 

3.  p  =  cln(ra)/r,  .4  <  c  <  1,  and  limn,r_oo  ln(r)ln2(n)n1-c/r  =  0. 

Proof: 

Since  Ai  does  not  “give  up”  if  at  least  one  null  clause  is  present  in  the  given  instance 
of  SAT  and  since  Aj  and  A  2  perform  as  needed  if  p  >  In (n)/r  and  p  <  .4ln(n)/r  we 
need  only  show  that  A3  “gives  up”  on  some  iteration  with  probability  tending  to  0  if 
.4ln(n)/r  <  p  <  ln(n)/r  and  limTlir_>00ln(r)lnJ(n)n1~c/r  =  0.  From  theorem  2  we 
have 

£Wi)}  =  ^42  =2(r-i-l)p1(l-p)'(l-2p)’-l-'n.  (4) 

r  -  J 

By  setting  the  derivative  of  (4)  to  zero  we  find  that  has  a  maximum  at 

j  =  j0  —  r  ~  1  —  l/(ln(l  —  p)  -  ln(l  —  2 p)).  Substituting  j0  for  j  in  (4)  gives 

_r  .  ..  2p2(l  -  p)r_1“  -2 

£{W1(J')}  =  - ln(l  —  p)  —  ln(l  -  2p)  - "•  (5) 
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Since  ln(l  —  p)  —  ln(l  —  2 p)  =  p  +  0(p 2),  p  =  cln(n)/r,  .4  <  c  <  1  and  n  is  not 
exponential  in  r  we  can  write  (5)  as 


If  limn^-^oo  ln(r)ln3(n)n1_c/r  =  0  we  have 

lim  ln(r)ln(n)S{u;i(j£>)}  =  0.  (6) 

n,r— *oo 

The  probability  that  a  complementary  pair  of  unit  clauses  appears  during  execution 
of  A3  is  less  than  the  sum  over  all  j  of  the  probabilities  that  a  complementary  pair 
appears  during  iteration  j.  The  probability  that  a  complementary  pair  appears  during 
iteration  j  is  less  than  the  expected  number  of  complementary  pairs  generated  at 
iteration  j.  Therefore  the  probability  that  A3  “gives  up”  is 

E{w\ (j  +  l)}/2  +  E{rii(j)  *  wi (j  4- 1)}  .  . 

2(r-j)  ‘ 

First  consider  the  E{ni(j)  *  wi(j  +  1)}  terms.  Let  p  be  the  list  of  literals  chosen 
during  execution  of  A3.  Let  Np(j)  be  the  collection  of  clauses  in  the  original  instance 
of  SAT  which  become  unit  clauses  and  from  which  literals  are  chosen  because  they 
become  unit  clauses  during  the  first  j  literal  choices  of  p.  Clauses  in  the  original 
instance  of  SAT  that  correspond  to  clauses  that  flow  into  Cj(j)  contain  an  unchosen 
literal,  the  complement  of  the  jth  chosen  literal  and  possibly  some  literals  which  are 
all  complementary  to  chosen  literals.  Therefore,  the  probability,  denoted  gp(r,p,j), 
that  a  particular  clause  of  the  original  instance  of  SAT,  which  is  not  in  Np(j),  flows 
into  C\(j)  given  p  is 


«  l«<n)(i  +  0(>))  , 


^  2cln(n)^ 


yri+dl^  _1  n 


9/>{r*PJ)  =  2P2(t~  J')(l  “2p)r  ■'(l-p)J.  (8) 

The  number  of  such  clauses  is  binomially  distributed  with  parameters  n  —  |iVp(j)| 
and  gp(r,p,j)  since  all  clauses  are  constructed  independently.  Using  the  Chernoff 
bound  for  binomial  distributions  [14],  and  realizing  that  the  bound  is  maximum  if 
| iVp(.7 ) |  =  0,  the  probability  that  the  number  of  clauses  flowing  into  Ci(j)  is  greater 
than  ln(n)  is  less  than  n-u,(n)  if  limn,r_oo  ln(r)  ln2(n)n1-c/r  =  0.  Therefore 

2 

E{ni(j)  *  u’i(;  +  1)}  <  ln(n)£{n,(>)}  +  (9) 
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Proceeding  in  the  same  way  for  the  E{w\(j)}  terms  results  in 


E{wl(j)}  <  ln(n)E{u;1(j)}  +  .  (10) 

We  only  need  to  find  E{ni(j)}.  Since  u>i(0)  =  0,  u>i(r  —  1)  =  0  and  at  least  one 
unit  clause  is  removed  on  any  iteration  that  unit  clauses  are  present,  we  may  use  the 
following  inequality  and  equation  for  a  work  conserving,  non-preemptive  single  server 
queueing  system  in  which  each  unit  of  time  is  an  iteration  of  A3: 


E*{W}<Em{n  ,}  +  l  (11) 

Em{n1}  =  E'{w1}  +  E*{W}  (12) 

Inequality  (12)  is  Little’s  law  and  (11)  comes  from  [4].  In  this  queueing  system  “ser¬ 
viced  jobs”  are  unit  clauses  that  are  removed.  The  maximum  residual  “service  time” 
observed  by  a  clause  when  it  becomes  a  unit  clause  (enters  the  system)  is  one  it¬ 
eration.  In  (11)  and  (12)  E*{W}  is  the  average  number  of  iterations  that  a  unit 
clause  waits  before  it  is  removed  if  the  expected  number  of  unit  clauses  present  on 
any  iteration  were  equal  to  the  maximum  expected  number  of  unit  clauses  present 
over  all  j,  0  <  3  <  r  —  1.  Em{nj }  is  the  maximum  expected  number  of  unit  clauses 
present  over  all  j,  0  <  j  <  r  —  1.  Finally,  £*{10!}  is  the  maximum  expected  flow 
into  the  collection  of  unit  clauses  over  all  j,  0  <  j  <  r  —  1.  Both  (11)  and  (12)  are 
independent  of  the  order  in  which  unit  clauses  are  removed  and  distribution  of  nj(j) 
and  tt>i (j).  Both  (11)  and  (12)  are  valid  only  if  J5*{u>i}  <  1  and  this  is  the  case  if 
limn)r_oo  ln(r)  ln2(n)n1-c/r  =  0  because  of  (6).  Combining  (11)  and  (12)  gives 


£*{*!}  < 


E-{w  1} 

1  -  £*{«>!}' 


(13) 


Combining  (7),  (9),  (10)  and  (13)  we  get  that,  in  the  limit,  (7)  is  less  than 


r—  1 

K  ln(n)£*{u;i}  ^ 
j= 0 


1 

r  -j 


<  K  ln(n)  ln(r).E*  {to! } 


(14) 


where  K  is  some  constant  greater  than  zero.  From  (6)  we  have  that  (14)  tends  to  0 
asn,r  -*  00.  Thus,  the  probability  that  >13  “gives  up”  when  p  =  cln(n)/r,  .4  <  c  <  1 
and  limn,r_ooln(r)ln2(n)n1-c/r  =  0  tends  to  0  as  n,r  — >  00. 


4.  Where  A3  Fail* 

In  the  previous  section  it  was  shown  that  As  “gives  up”  with  probability  tending  to  0  if  p  = 
cln(n)/r,  .4  <  c  <  1,  and  lim„,r_ooln(r)ln2(n)nl-c/r  =  0-  In  this  section  we  show  that 
this  result  is  tight  to  within  the  factor  ln(r)ln(n).  That  is,  we  show  that  A3  “gives  up”  with 
prooability  tending  to  1  if  p  —  c  ln^7i)/r ,  *4  ^  c  ^  1,  li^n,r— *00  ln^Jn1  c/r  >  e(l  +  7)/c, 
7  >  0,  and  n  <  2rl_<  for  any  6  >  0.  We  also  show  that  if  p  =  cln(n)/r,  .4  <  c  <  1,  and 
limn>r_oo  n1_e/r  =  00  then  the  probability  that  a  random  instance  is  unsatisfiable  tends 
to  1.  Thus  A3  does  not  give  up  with  probability  tending  to  1  over  almost  all  relationships 
between  n  and  r  that  admit  satisfiable  instances  when  p  =  cln(n)/r,  .4  <  c  <  1. 

Recall  that 

E{wi (j)>  =  2(r  -  j  -  l)p2(l  -  p)J(l  -  2p)r-2_Jn 

and  E{w\(j)}  is  maximum  at  j  =  j0  —  r  —  1  —  r/(cln(n))  (the  lower  order  terms  are  removed 
to  avoid  unnecessary  clutter).  Consider  the  interval  — r/(2cln(n))  <j  <  j0  +  r/(2c\n(n)) 
which  we  refer  to  as  Ja.  It  is  straightforward  to  verify  that  £{u>i(j)}  >1+7  for  any  7  >  0 
at  the  endpoints  of  Ja  if  lim„)r_00 ln(n)«1-c/r  >  e2(l  +  7 )/c.  Since  F{tiii(j)}  has  one 
maximum  (at  j  =  j0),  if  J?{u;i(j)}  >  1  +  7  at  both  endpoints  of  Ja  then  £{uii(j)}  >1+7 
at  all  points  internal  to  J„.  Then,  for  at  least  r/(cln(n))  iterations  the  average  flow  into  the 
set  of  unit  clauses  is  greater  than  1  +7.  Suppose  that,  on  at  least  r4/2  of  those  iterations, 
more  than  one  clause  is  eliminated  from  the  set  of  unit  clauses.  Since  unit  clauses  are 
independent,  the  probability  that  a  set  of  at  least  two  unit  clauses  eliminated  on  some 
iteration  of  Aj  contains  a  complementary  pair  of  literals  is  at  least  1/2.  Therefore  the 
probability  that  at  least  one  set  of  unit  clauses  contains  a  complementary  pair  of  unit 
clauses  (A3  gives  up  in  this  case)  is  at  least  1  —  (l/2)r  '  which  tends  to  1.  Now  suppose 
that  more  than  one  clause  is  eliminated  from  the  set  of  unit  clauses  on  no  more  than  r4/2 
iterations  of  A3.  Using  the  Chernoff  bound  for  binomial  distributions,  again,  we  find  that 
the  probability  that  more  than  r4/4  unit  clauses  are  eliminated  on  any  iteration  is  less  than 
e_r4/’  Then  the  probability  that  more  than  one  clause  is  eliminated  from  the  set  of  unit 
clauses  on  at  least  one  of  r4^2  iterations  is  less  than  r4/2e-r  which  tends  to  0.  Thus, 
the  average  number  of  clauses  eliminated  during  the  iterations  corresponding  to  J„  is  less 
than  r4/2  with  probability  tending  to  1.  This  implies  that  the  average  number  of  clauses 
remaining  at  the  j  —  j „  =  r  —  1  —  r/(2cln(n))  iteration  is  greater  than  r/ln(n)  -  r4/2.  It 
is  straightforward  to  show  that  this  and  the  assumption  that  n  <  2r  '  imply  the  number 
of  clauses  in  the  set  of  unit  clauses  is  at  least  (r/ln(n))J/4  in  the  limit  at  j  =  ju  with 
probability  tending  to  1.  The  number  of  variables  not  assigned  values  at  that  iteration 
is  r/2ln(n).  Since  all  unit  clauses  are  independent  we  may  use  the  result  of  [l]  which 
says  that  the  probability  that  an  instance  of  1-SAT  (one  literal  per  clause)  containing  n 


clauses  composed  from  f  variables  is  unsatisfiable  with  probability  tending  to  1  if  n  >  \/f 
and  conclude  that  at  the  j  —  ju  iteration  there  is  at  least  one  pair  of  complementary  unit 
clauses  (A3  gives  up  in  this  case,  also)  with  probability  tending  to  1.  This  argument  shows 

Theorem  4: 

Let  c,  7  and  6  be  any  constants  such  that  .4<c<1,7>0  and  6  >  0.  If  p  =  cln(n)/r, 
n  <  2rl  * ,  and  limniP_»oo  ln(n)n1-c/r  >  e(l+7)/e  then  A3  “gives  up”  with  probability 
tending  to  1  as  n,r  ->  00. 

The  next  theorem  gives  a  condition  under  which  random  instances  of  SAT  are  unsat¬ 
isfiable  with  probability  tending  to  1. 

Theorem  5: 

Let  c  be  a  constant  such  that  .4  <  c  <  1.  If  p  =  cln(n)/r  and 

limnir_00 nl~c/r  =  00  then  an  instance  of  SAT  generated  according  to  J(n,r,p)  is 
unsatisfiable  with  probability  tending  to  1. 

Proof: 

Let  i  be  a  random  truth  assignment  to  the  variables  of  V.  The  probability  that  a 
random  clause  has  value  true  under  t  is  the  probability  that  at  least  one  literal  in 
the  clause  is  made  true  by  t.  This  is  one  minus  the  probability  that  none  of  the 
literals  is  made  true.  The  probability  that  none  of  the  literals  is  made  true  by  t 
is  (1  —  p)r.  Hence,  the  probability  that  a  random  clause  has  value  true  under  t  is 
1  —  (1  —  p)r.  The  probability  that  n  clauses  chosen  independently  have  value  true 
is  (1  —  (1  —  p)r)n.  Therefore,  the  average  number  of  truth  assignments  satisfying  all 
clauses  is  2r(l  —  (1  —  p)r)n.  Since  p  =  c\n(n)/r  this  is  erln^2^e-nl  *  as  n,r  — ►  00. 
But  this  expression  tends  to  zero  if  limniP_00  n1_c/r  =  00.  Since  the  average  number 
of  satisfying  truth  assignments  is  an  upper  bound  for  the  probability  that  there  is  at 
least  one  satisfying  truth  assignment,  the  theorem  is  proved. 

From  theorems  3  and  5  we  have  that  if  p  =  cln(n)/r,  .4  <  c  <  1  and  n  <  2r  then  a 
random  instance  of  SAT  generated  according  to  J(n,r,p)  almost  never  has  a  solution  if 
limn^—oo  n1-e/r  =  00  but  a  solution  will  almost  always  be  found  by  A3  if,  for  any  e  >  0, 
lim„,P_oo  n1~c/r1~t  <  00.  These  conditions  define  the  line  called  “SAT  BOUNDARY”  in 
Figure  1  such  that  points  to  the  right  of  that  line  (limniP_o0  n1-c/r1~‘  <  00)  correspond  to 
sets  of  parameter  values  that  result  either  in  almost  all  random  instances  being  satisfiable 
or  containing  a  null  clause,  and  all  points  to  the  left  of  that  line  correspond  to  values 


leading  to  the  generation  of  unsatisfiable  instances,  almost  always.  Since  Aj  nearly  always 
finds  a  solution  when  p  >  ln(n)/r  and  since  almost  all  random  instances  are  unsatisfiable 
when  p  <  .4ln(n)/r,  the  collection  of  algorithms  mentioned  here  has  been  shown  to  be 
very  effective  in  finding  solutions  to  random  instances  of  SAT  when  at  least  one  solution 
exists. 

5.  Conclusion 

We  have  shown  that  the  combination  of  algorithms  Ai ,  A2  and  A3  solve  random  instances  of 
SAT  generated  according  to  J(n,r,p)  with  probability  tending  to  1  as  n,r  — ►  00  as  long  as 
p  <  .4ln(n)/r  orp  >  In (n)/r  or  p  =  cln(n)/r,  .4  <  c  <  1  andlimn,r— ooln(r)ln2(n)ra1-c/r  = 
0.  The  region  of  the  parameter  space  now  known,  but  not  previously  known,  to  correspond 
to  instances  which  can  be  solved  in  polynomial  time  almost  always  is  shown  shaded  in  Fig¬ 
ure  1.  Noting  the  relationship  between  the  shaded  area,  the  area  to  the  right  of  II  and 
the  “SAT  BOUNDARY”  in  Figure  1,  we  see  that  no  algorithm  for  finding  a  satisfying 
truth  assignment,  when  one  exists,  can  perform  much  better  than  A3.  The  only  region  of 
the  input  model  parameters  not  yet  known  to  be  covered  by  a  fast  algorithm  with  good 
probabilistic  performance  is  p  =  cln(n)/r,  .4  <  c  <  1  and  limr,)r_0oln(r)ln2(n)n1“c/r  >  0 
(bounded  by  I  and  the  “SAT  BOUNDARY”  line  in  Figure  1).  Instances  generated  in  this 
region  of  the  parameter  space  are  almost  always  unsatisfiable. 

The  result  presented  here  represents  an  interesting  improvement  over  previous  results. 
According  to  the  best  previous  result,  bactracking  with  the  pure  literal  rule  runs  in  poly¬ 
nomial  average  time  when  nln(n)  <  a^Jr ln(r),  a  constant,  in  the  range  .4ln(n)/r  <  p  < 
ln(n)/r.  This  means  np,  the  average  number  of  clauses  containing  a  variable  randomly 
chosen  from  the  given  set  of  r  variables,  is  less  than  a  constant  times  y/ln(r)/r.  Since  the 
number  of  clauses  containing  a  particular  variable  is  binomially  distributed,  we  may  use 
the  chernoff  bound  for  binomial  distributions  and  find  that  the  probability  that  a  variable 
appears  in  more  than  one  clause  is  less  than  e-a'/r/ln(r).  Since  variables  appear  in  clauses 
independently,  the  probability  that  all  variables  are  in  at  most  one  clause  is  greater  than 
(1  —  e-aVr/ln( r))r  which  tends  to  1  as  r  — ►  00.  Thus,  almost  all  instances  in  the  range 
nln(n)  <  Cy/r ln(r),  ,4ln(n)/r  <  p  <  ln(n)/r  have  no  variable  present  in  more  than  one 
clause.  Such  instances  are  probably  not  very  interesting  and  can  be  solved  easily  by  as¬ 
signing  the  value  true  to  every  literal  in  the  instance.  On  the  other  hand  examples  of 
regions  in  which  almost  every  random  instance  of  SAT  may  be  solved  in  polynomial  time 
by  the  algorithms  presented  here  are  p  =  .4ln(n)/r  and  n  =  o(r5/3)  or  p  =  .5ln(n)/r  and 
n  =  o(r2)  or  p  =  .75ln(n)/r  and  n  =  o(r4)  or  p  >  ln(n)/r.  In  all  these  examples  the 
average  number  of  clauses  containing  a  particular  literal  may  be  increasing  with  r  and  n. 

Finally,  we  comment  that  our  result  is  much  stronger  than  a  similar  result  obtained 


in  [8]  since  that  result  required  p  to  be  fixed  while  our  result  holds  even  if  p  tends  to  0. 
To  see  the  difference  in  the  proper  perspective  notice  that  if  p  is  fixed  then  the  average 
number  of  literals  in  a  clause  is  0(r).  However,  our  results  hold  even  if  the  average  number 
of  literals  in  a  clause  is  o(r)  or  o(n).  The  most  interesting  instances  have  ©(log(n))  literals 
per  clause,  on  the  average  (these  are  generated  in  the  vicinity  of  the  “SAT  BOUNDARY” 
line  of  Figure  1).  Our  results  apply  to  such  instances  whereas  the  results  of  [8]  do  not  if  n 
and  r  are  polynomially  related  (in  fact,  those  results  apply  only  to  instances  which  have 
far  more  literals  per  clause  and  are  “very”  satisfiable). 
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Figure  1:  The  parameter  space  for  which  Aj,  Aj  and  Aj  almost  always  solve  a  random  instance 
of  SAT  generated  under  J(n,r,k).  Aj  works  well,  in  probability,  in  the  region  to  the 
left  of  curve  I.  A\  works  well,  in  probability,  in  the  region  to  the  right  of  II.  Aj  works 
well,  in  probability,  in  the  hatched  region. 
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